Neural Network Compression via Low Frequency Preference

نویسندگان

چکیده

Network pruning has been widely used in model compression techniques, and offers a promising prospect for deploying models on devices with limited resources. Nevertheless, existing methods merely consider the importance of feature maps filters spatial domain. In this paper, we re-consider characteristics propose novel filter method that corresponds to human visual system, termed Low Frequency Preference (LFP), frequency It is essentially an indicator determines based relative low-frequency components across channels, which can be intuitively understood as measurement “low-frequency components”. When map more than other maps, it considered crucial should preserved during process. We conduct proposed LFP three different scales datasets through several achieve superior performances. The experimental results obtained CIFAR ImageNet dataset demonstrate our significantly reduces size FLOPs. UC Merced show approach also significant remote sensing image classification.

برای دانلود باید عضویت طلایی داشته باشید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Image compression using frequency sensitive competitive neural network

Vector Quantization is one of the most powerful techniques used for speech and image compression at medium to low bit rates. Frequency Sensitive Competitive Learning algorithm (FSCL) is particularly effective for adaptive vector quantization in image compression systems. This paper presents a compression scheme for grayscale still images, by using this FSCL method. In this paper, we have genera...

متن کامل

Fast and low-frequency adaptation in neural network control

In adaptive neural network (NN) control, fast adaptation through high-gain learning rates can cause high-frequency oscillations in control response resulting in system instability. This study presents a simple adaptive NN with proportional derivative (PD) control strategy to achieve fast and low-frequency adaptation for a class of uncertain non-linear systems. Variable-gain PD control without t...

متن کامل

Universal Deep Neural Network Compression

Compression of deep neural networks (DNNs) for memoryand computation-efficient compact feature representations becomes a critical problem particularly for deployment of DNNs on resource-limited platforms. In this paper, we investigate lossy compression of DNNs by weight quantization and lossless source coding for memory-efficient inference. Whereas the previous work addressed non-universal scal...

متن کامل

Monitoring of Regional Low-Flow Frequency Using Artificial Neural Networks

Ecosystem of arid and semiarid regions of the world, much of the country lies in the sensitive and fragile environment Canvases are that factors in the extinction and destruction are easily destroyed in this paper, artificial neural networks (ANNs) are introduced to obtain improved regional low-flow estimates at ungauged sites. A multilayer perceptron (MLP) network is used to identify the funct...

متن کامل

Low Frequency Oscillations Suppression via CPSO based Damping Controller

In this paper, the Unified Power Flow Controller (UPFC) is enhanced with a Chaotic Particle Swarm Optimization (CPSO) Damping Controller in order to mitigate the Low Frequency Oscillations (LFO) in a Single Machine Infinite Bus (SMIB) power system. The designed damping controller is an optimized lead-lag controller, which extracts the speed deviation of the generator rotor and generates the out...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

ژورنال

عنوان ژورنال: Remote Sensing

سال: 2023

ISSN: ['2315-4632', '2315-4675']

DOI: https://doi.org/10.3390/rs15123144